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Abstract 

We study the feasibility of short finite impulse response (FIR) synthesis for perfect reconstruction 
(PR) in generic FIR filter banks. Among all PR synthesis banks, we focus on the one with the minimum 
filter length. For filter banks with oversampling factors of at least two, we provide prescriptions for 
the shortest filter length of the synthesis bank that would guarantee PR almost surely. The prescribed 
length is as short or shorter than the analysis filters and has an approximate inverse relationship with the 
oversampling factor. Our results are in form of necessary and sufficient statements that hold genericaUy, 
hence only fail for elaborately-designed nongeneric examples. We provide extensive numerical verification 
of the theoretical results and demonstrate that the gap between the derived filter length prescriptions and 
the true minimum is small. The results have potential appUcations in synthesis FB design problems, where 
the analysis bank is given, and for analysis of fundamental limitations in blind signals reconstruction 
from data collected by unknown subsampled multi-channel systems. 
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I. Introduction 

A. Oversampled filter banks 

Filter banks with perfect reconstruction (PR), or near PR, are the most ubiquitous signal processing 
structure in multi-rate digital systems with applications in broad areas of signal, image, and video 
processing 01, 121, Q. Fig. [TJa) shows a C-channel D-fold subsampled filter bank (FB). Here, a FB is 
considered to achieve PR if it reconstructs an exact though possibly delayed replica — no] of the input 
x[n], that is, x[n] = x[n — no] for some integer delay no- Filter banks can be categorized as: (/) critically 
sampled or maximally decimated, i.e., when the downsampling factor D equals the number of channels 
C; or (//) oversampled, when there are more channels than the downsampling factor, i.e., C > D. 

For critically sampled FBs, the PR requirement is typically in conflict with other desirable design 
specifications. In the oversampled case, however, with a given set of analysis filters, an infinite number 
of PR synthesis filters exist llH. The main advantage of oversampled FBs are the added degrees of design 
freedom gained from this redundancy, which have been exploited for the reduction of quantization noise in 
digital communication systems |[5l, ||6l, for improved equalization and precoding in data communication 
JTI, JH, and in image transmission fOl and image coding lilOil . 

B. The role of FBs in multi-channel systems 

Multi-channel data acquisition/sampling arises in various sensing, imaging, and data processing modal- 
ities including data communication/storage applications, remote sensing/imaging, and medical imaging 
systems such as magnetic resonance imaging (MRI) ifTTIl . The continuous-time model for a C-channel 
sampling (data acquisition) and reconstruction system is illustrated in Fig. [TJb). The channel outputs are 
sampled prior to digital processing, say, with a uniform sampling rate T. The objective is to perfectly 
reconstruct the input signal from the sampled output signals yi[n\ = yi{nT), i.e., to design the signal 
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Fig. 1: (a) C-channel Filter Bank with Z3-fold subsampling. The ratio C/D is referred to as the oversampling 
factor, (b) Model for multi-channel sampling and reconstruction. 
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reconstruction mechanism in Fig. [T]^b), so that x{t) = x{t). 

If the channel characteristics are known, the problem reduces to a well-studied problem in sampling 
theory, widely knowns as Papoulis generalized sampling lfT2l . |[T3l and its generalizations to the over- 
sampled case |[T3l . |[T4l and to multi-dimensional (MD) sampling |[T5l of MD signals llT6ll . Examples 
of MD multi-channel systems include sensor arrays with sampling in space and time, and multi-channel 
(parallel) MRI [11] with spatio-temporal sampUng (ITl, ifTSl . 

The analysis simplifies by a fully discrete-time formulation. Under mild conditions |fT9l . we can convert 
the continuous-time channel model in Fig. [TJ^b) into the discrete-time model (FB structure) in Fig. [Ija), 
where x[n\ and x[n\ represent samples of x{t) and x{t) taken at a sufficiently high rate, and the D- 
fold subsampling models the sub-Nyquist sampling of the channels in Fig. [ijb). Although all channels 
in Fig. ^a) have identical uniform subsampling, this setup is fairly general and subsumes periodic 
nonuniform subsampling ll20l . It follows that FBs represent equivalent discrete-time models for a wide 
class of multi-channel data acquisition/sampling systems. 

C. Generic FBs: motivation for short synthesis filters 

In most FB-related problems, it is assumed that one has the luxury to almost freely manipulate the 
analysis filters, and the goal is to design the entire FB with desirable properties such as robustness to noise 
or erasures, frequency selectivity, etc. H, 0, ||9l- However, considering FBs as models for multi-channel 
systems, often Uttle or no control can be exerted over the analysis filters since their characteristics are 
dictated by the underlying physics. This is the case in important sensing, imaging, and image processing 
applications. Examples of such "sensor filters" include spatial sensitivity of receivers in multi-channel 
MRI (ni, lED, lEl, ||23l, or blurring kernels associated with remote imaging applications II24II . 1125 II . 
Furthermore, since the sensor filters result from complex physical processes, a pathological case would 
be extremely unlikely; in other words, the corresponding analysis filters are "generic" (further described 
in Section II- A[ ). Therefore, in this work, we focus on scenarios wherein the set of analysis filters, also 



called the analysis bank, is fixed and generic. Such a generic analysis covers most practical applications 
of multi-channel sensing and imaging. It has the added advantage of revealing the properties that are 
inherited from the FB structure rather than specific values of the filter taps. 

Another important aspect of FBs is the length of the filters in the synthesis bank: infinite or finite 
impulse response (IIR/FIR). Given the analysis bank, the PR synthesis bank is typically designed to 
equal (or closely approximate) the so-called para-pseudoinverse or dual-frame synthesis bank ||4l, ll26ll . 
to minimize the reconstruction noise gain. Unless the analysis bank meets stringent condition |[26]| . lITTll . 
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which almost surely do not hold for generic FBs, the dual-frame synthesis is IIR. Even if the exact 
PR condition is relaxed to approximate PR, accurate approximations of the dual-frame synthesis bank 
requires long synthesis filters l!28l, 1129^1 Q An alternative to such approaches is to search for the "best" 
FIR synthesis bank that achieves PR — and simultaneously satisfies additional optimality criteria ||30ll . 
[|3n . In particular, short FIR PR synthesis banks have important advantages including the following: 

- Short PR FB reconstruction is computationally very efficient, as compared to the IIR dual-frame 
synthesis bank or alternative non-FB reconstructions such as the least-squares solution. 

- A short FIR synthesis bank implies a low-dimensional search space for the synthesis FB design 
algorithm, hence reducing the computational complexity and, more importantly, improving the 
optimized design. This is especially significant for practical design techniques that employ additional 
desired criteria (besides PR) in a non-convex optimization scheme (e.g., EH). 

- In certain applications, such as data communications or storage, the multi-channel data is corrupted 
by "impulsive noise" |[32l . ||33l . which can also model channel erasures [9], or dead pixels in 
a sensor. The noise-optimal dual-frame synthesis bank (generically IIR) or non-FB reconstruction 
using the maximum-likelihood (least squares) solution would corrupt the entire reconstructed signal. 
Instead, short FIR synthesis can provide "good" reconstruction in such scenarios, achieving PR 
everywhere except in the neighborhood of the noise spikes ll34ll . 

These advantages and the prevalence of the generic FB scenario in multi-channel systems motivate the 
work in this paper. 

D. Present Work 

This work addresses the feasibility of short FIR synthesis for PR (allowing for reconstruction delay 
— delayed PR) in generic complex-valued FIR one-dimensional (ID) FBs. Specifically, we address the 
following two questions for a C-channel FIR generic analysis FB with D-fold subsampling and analysis 
filter length m^: 

[Q.l] Feasibility of FIR Synthesis: What are the conditions for existence of an FIR synthesis bank that 
achieves PR or delayed PR? 

[Q.2] Feasibility of Short Synthesis and Effect of Oversampling: what is the minimum feasible filter length 
m* among all PR (or delayed PR) synthesis banks — and how does it depend on the oversampling factor 

C/D? 

'a "snug" (almost tight) analysis frame is an exception (4), 1291 , which does not occur for generic FBs. 
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With D = 1, the FB is nonsubsampled |[26l and the reconstruction problem is equivalent to multi- 
channel deconvolution. For this case, Q.l has been extensively studied in the theory of polynomials |35'|, 
|[36l . Further, Q.2 has been addressed in previous work by Harikumar and Bresler in ID (with C > 2) 
|[37l and 2D (with C > 3) iMl- In the ID case with generic channels, they provide prescriptions for 
deconvolver lengths that are both necessary and sufficient for PR ||37l . 

For the subsampled {D > 1) case, although the conditions for PR for a given critically sampled and 
oversampled FB have been known for many years llH, ll26l . Q.l has only been recently answered by Law 
et al. [38], in fact for the more general case of MD signals. (We discuss their relevant result in Section 
[V] ) However, to the best of our knowledge, Q.2 is an open problem. 

The significance of Q.2 is perhaps best appreciated in the context of blind signal PR, i.e., the perfect 
inversion of subsampled multi-channel systems (i.e., the analysis FB) by identification of a PR synthesis 
bank without any prior knowledge of the channels. For this class of problems only the nonsubsampled 
case, i.e., the problem of blind multi-channel deconvolution, is fully studied (see |[39l . BOl and references 
therein). In subsampled systems little rigorous analysis is available of both necessary and sufficient 
conditions for blind PR (for relevant work in 2D see 1411 . ll42ll . ||43]| and references therein). In such 
problems, where an FIR synthesis bank is to be identified, the length (support size) of the synthesis filters 
is a fundamental issue as it dictates the dimensionality of the unknown parameter space. In fact, given 
limited available data, as the length allocated for the synthesis filters increases (more unknowns to solve 
for), the inverse problem of estimating the synthesis filters becomes progressively more difficult and/or 
ill-posed. (This is compounded by the concomitant increase in computational cost with more unknowns.) 
Therefore, it is important to constrain the FB length. On the other hand, reducing the dimensionality 
too much would make PR infeasible. Consequently, knowing where this phase transition between PR 
feasibility/infeasibility occurs becomes critical. Having the answer to Q.2, one would be able to (i) find the 
minimally required dimensionality of the parameter space to enable PR; and (ii) analyze the fundamental 
trade-offs, such as the oversampling factor needed to guarantee a "feasible" (low dimensional) search 
space. 

In this work, we address the above-raised two questions for generic FIR analysis banks that are at 
least 2-fold oversampled; this subsumes most practical cases of oversampled FBs. We show that with 
such oversampling factors, PR is almost surely feasible with a synthesis bank that consists of filters as 
short or shorter than the analysis filters. Furthermore, we show that the required length for the synthesis 
filters has an inverse relationship to the oversampling factor. 

Our results indicate that satisfying the PR condition per se is quite easy — even a random choice will 
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do — if the filter lengtlis satisfy certain conditions. Hence, we can guarantee feasibility of exact PR in 
the design of a FB by prescribing the analysis/synthesis filter lengths. This implies that the degrees of 
freedom in the design process can be mostly driven by other desired criteria, e.g., reconstruction noise 
gain [5|, frequency selectivity, time/frequency localization, subband attenuation |!44l|, or coding gain [45] 
— all while guaranteeing PR. For the problem of designing a PR synthesis bank given the analysis bank, 
our results provide an alternative to the expensive exhaustive search for the synthesis filter length ll3T1l . 
The paper is organized as follows. Section |ll] contains basic definitions and notations. In Sections III 



and |IV| respectively, we present necessary and sufficient requirements on the minimal filter length for 
the PR synthesis bank. Section |V] uses these results to address Questions Q.l and Q.2. In Section VI 



we 



provide numerical verification of the theoretical results; further, we study the feasibility of near-PR using 



synthesis filter lengths below those prescribed by our propositions. Finally, Section VII summarizes the 
results and concludes the paper. 

II. Preliminaries 

A. Notations and Setup 

For a G M, \a] (respectively, [a\ ) denotes the smallest (respectively, largest) integer larger (respectively, 
smaller) than or equal to a. Column vectors and matrices are denoted by lowercase and uppercase letters, 
respectively. The elements of a vector a are indexed as a[i], < i < — 1; similarly, the elements 
of a matrix are denoted as with upper-left element A[0, 0]. Signals and column vectors are used 

interchangeably. The length of a signal or vector s is denoted by rus. For a matrix A, its transpose and 
Hermitian are denoted by A^^ and A^, respectively; ^{A) is its range (column) space and A"^ is its Moore- 
Penrose pseudoinverse. The notation vec[yl] denotes the vector obtained by concatenating columns of A 
in lexicographical order. Similarly, concatenation of a sequence of vectors i into a single vector is 

denoted by vec[{aj}" J. 

The shifted unit pulse 6m{N) is defined as the (m + l)-th column of the N x N identity matrix, 
In most cases, the N argument in 6m{N) can be inferred from the context and is dropped for notational 
brevity. The convolution of s[n\ and h[n\ is denoted by {s * h)[n] and is equivalently written in vector 
form as Cm^{h}s, where Cm^{/i} is the matrix representation of the convolution operator, which is a 
Toeplitz matrix of size of {mh + ms — 1) x m^. Finally, we define the "stack" of all convolution matrices 
corresponding to the analysis channels as follows: 



(1) 
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Consider the standard C-channel filter bank (FB) structure with Z'-fold subsampling shown in Fig. [TJ^a). 
We focus on oversampled FB, i.e., where the oversampling factor C/D > 1. The transfer functions of 
the analysis and synthesis filters are denoted by Hi{z) and Vi{z), respectively, and their corresponding 
impulse responses, assumed to be FIR, by hi[n] and Vi[n]. For brevity, we refer to the set of analysis 
(respectively, synthesis) filters as the analysis (respectively, synthesis) bank. It is assumed that the support 
of all filters in the analysis (respectively, synthesis) bank is the same and — without loss of generality — 
is right-sided (that is, the filters are causal). Consequently, all analysis (respectively, synthesis) filters have 
equal length, denoted by my^ (respectively, mt,)|^For example, the support for hi[n] is < n < — 1. 
We therefore have the following expressions for the z-transforms of the filters: Hi{z) = Yl^=o'^ hi[n]z^^ 
andy,(z) = E™=o'^an]^-". 

Most of the theoretical work here involves study of "generic" properties of vectors and matrices. We 
use the same definition for a property to hold "generically" as in previous works 041 . ll37l : If a property 

of a vector a G fails to hold only on a closed set of measure zero that is nowhere dens^in R", 
we say that the property holds for generic a, or equivalently, V holds generically. As a result, V will 
hold with probability 1 (short form: "w.p.l") when the elements of the vector a are drawn independently 
from a probability distribution that admits a probability density functioij^ Furthermore, property V is 
robust, in the sense that V continues to hold for any sufficiently small perturbation of such a randomly 
generated a. A more mathematically rigorous definition ll38l . or an alternative but equivalent notion of a 
generic property WH can be found elsewhere. 

B. PR in Polyphase Domain 

The polyphase decomposition fl], of the analysis filters Hi{z) is given by 

D-l oo 

= J]^PH,,p(z^), where Hi,p(z) = J] /i, [nZ? - p] z"" (2) 

p=0 n=— oo 

is the p-th polyphase component (p = 0, . . . , D—1) of the i-th analysis filter. The polyphase decomposition 
of the synthesis filters is similar, but with opposite signs for the index p: 

D-l oo 

Vi{z) = Y,z-P\i,p{z''), \^,p{z)= v^[nD + p\z-''. (3) 

p=0 n=— oo 

^This is not a limiting assumption as one can take the length of a set of filters {/,;[n]}^i to be m/ = maxm/.. 

set S is dense in R if for all a; G R, any neighborhood of x contains at least one point from S. For example, the rational 
numbers are dense in R. A complete definition can be found in |46|. 

^The probability distribution should be absolutely continuous with respect to Lebesgue measure. 
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ma 
D 



for some < Po < D - I. (4) 



There is a corresponding time-domain representation on both analysis and synthesis sides that, for each 
analysis/synthesis channel, involves partitioning of the filters taps into D subsequences — based on 
congruency of their indices modulo D. 

Define the impulse response corresponding to Hj ^(2:) as: hi^p[n] = hi[nD—p]; and denote its length by 
rrih-p, which is equal to rrih-p = . Similarly, the length of the impulse response fi,p[n] = Vi[nD+p] 

corresponding to Yi^p{z) is denoted by niv^p and is equal to rriy-p = - The following properties, 

for a = h and a = w, are easy consequences of these definitions: 

D-l 

rria-p = rua (b) J < rua-p < — (c) rria-p^ 

Based on the theory of filter banks im, m, the polyphase -domain condition for PR with an output 
delay of no = rrioD for all inputs x[n] is as follows: 

z-^'^'dJiD) VzeC, p = 0,...,D -I, (5) 

where the so-called analysis polyphase matrix A{z), which is a C x D (Laurent) polynomial matrix, has 
entries Aij{z) = Hj+i j(z), i = 0, . . . , C — 1, j = 0, . . . , D — 1. Collecting all D polyphase conditions 
in (|5]l into a single equivalent PR condition yields 

7^(z) A{z) = z^™" Id Vz G C, (6) 

where the D x C matrix Tl{z) with entries Tlij{z) = Yj^i^i{z), i = 0, . . . , D — 1, j = 0, . . . , C — 1, is 
referred to as the synthesis polyphase matrix. For the case of zero delay, (|6]l states the PR is achieved 
when the synthesis polyphase matrix is a left inverse of the analysis polyphase matrix, for all z G C. 
The sampling- (time-) domain counterpart of ^ can be written in the following form 



Vi,p(2;),V2,p(z), . . . , Vc,p(z) 



Aiz) 



C [{^j,(D-l)},1jm„;p 



vec 



^ K(p,moD) 



Up p = 0,...,{D-l), (7) 

where Hp is the sampling-domain analysis polyphase matrix and is of size {mh + Drriv-p — D) x (Cmt,;p)|^ 
Assuming < mo < [^J + [^J — 2, the right-hand side is a shifted unit pulse with the amount of 



^ In I?}, each of the matrices C[{/ii,fe}^j]^ for fc = 0, . . . , (D — 1) is of size {rrih-.k + rn^-.p — 1) x (C 1 
using X]^=o^ = mrih, it is seen that the matrix Hp is of size (mh + Drriy-p — D) x {C mv.p). 



Therefore, 
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shift K{p,moD) given b>j^ 

mo p = 



K{p,moD) 



-1 

mo + Ylk=o('^h;k + my;p "1) p = 1 , . . . , {D - 1) . 



n{z)A{z) 



(9) 



The abovementioned PR conditions correspond to cases where the delay allowed in PR is a multiple 
of the subsampling factor, i.e., no = moD. Nevertheless, the PR condition in Q can be extended to the 
general delayed PR with a delay of no = moD + ro, < ro < D — I, as follows (cf. [IJ, Ch. 5.6): 

O Z-^Ir„ 

where, in the D x D matrix on the right-hand side, O and O denote zero matrices of appropriate size. 
The corresponding sampling-domain condition will differ from Q only in the location of the 1 in the 
delay vector. In short, assuming < [^] < [^J + ['jf\ - 2, the PR condition with no = moD + ro 
delay is 

Mpvec {vi^p}t^ ='^«(p,no) p = 0,...,{D-l), (10) 

where ^^{p.no) is the inverse z-transform of the p-th row of the right-hand side of ([9]). The assumption on 
the range for no is needed for Q to be feasible; however, the present formulation can account for delays 
outside this range by proper zero-padding of analysis/synthesis impulse responses. The general closed- 
form expression for K{p,no), given in ^ for the special case of no = moD, is somewhat complicated 
and of no significance in this paper; hence, it is skipped here. 

To illustrate the structure of the sampling-domain analysis polyphase matrix Hp given in (|7]), consider 
for example a C = 6 channel FB with D = 2>, m^ = 7, and m^ = 6. The corresponding H2 is shown in 
Fig. [2[ In general, the structure of Hp consists of Toeplitz (rectangular) blocks of the form Cm^.p{hc„/} 
with C block-columns (l<Co<C) and D block-rows iO<l<D — 1). The zeros in the Toeplitz blocks are 
referred to as structural zeros — they are underlined to distinguish them from assigned zeros in our 
matrix constructions in the following sections. On occasion, we need to refer to an indeterminate zero, 
i.e., one that can be either assigned or structural, for which we use the notation 0. 

When mfi < D ox m^ < D, the system of equations in ( fTO] ) should be interpreted with some care: 
equations that correspond to m^-p = 0, and blocks in Hp corresponding to polyphase components in {hi} 

^For ([Sj to hold we need < mo < ruh-.k + rn^-p — 1 for < A;, p < D — 1, which implies the condition on mo given above. 
^This assumption can be relaxed to allow for larger no by appropriate zero-padding of the analysis filter taps. 
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that do not exist, should all be removed. Because of these complications and considering that the case 
rrih < D is of limited practical interest, we assume rrih > D throughout. 

Finally, given the analysis filters, the following sampling-domain necessary and sufficient condition 



for existence of a PR synthesis bank follows immediately from (10 1. 



Lemma 1. For a C-channel FB with given FIR analysis filters {hi[n\}f^^, a set of length-m^ synthesis 
filters achieving PR with delay uq, < < [^J + [^J — 2, exists if and only if 6f^(^p nQ) S 5^(Hp), 
for all p = 0, . . . , D — 1. 



III. Minimum Length for PR Synthesis Filters: Generic Sufficient Condition 

In this section we aim to answer Question Q.2 raised in Section [I] Specifically, for a length-m/i generic 
analysis FB with C-channels and D-fold subsampling, we propose a functional m^(C, D, nih) : N'^ — )■ N 
such that for all integers > ml{C, D, rrih) there exists a PR synthesis bank with filter length m^. 

A. Statement of the result 

Definition Denote by ml{C, D,mfi) the minimal value of rriy G N that satisfies: 

rrih-p - 1 



C 



D-1 



-E 



p=0 



(11) 



where m/j.p 
length. 



rrih-p 
D 



. We refer to rriy as the sufficient synthesis filter length, or in short the sufficient 



It is easy to show that ( [TT] ) is satisfied for any rriy > m^{C,D,mh). Therefore, the set of rriy G N 
satisfying ([TT]) is a right-sided interval, i.e., all integers in: m^(C, D, m/j), oo ) . The following lemma 



shows that for to be finite, at least two-fold oversampling is needed (assuming rrih > 2D, which is 
the case in most practical scenarios). The proof is provided in Appendix [A] 



Lemma 2. Suppose rrih > 2D. Then, if C / D < 2, (\\\ is not satisfied for any finite m^. 

In the following proposition, the main result of this section, we consider generic FIR analysis banks 
that are at least 2-fold oversampled, which, as stated in Lemma [2] is a requirement for the sufficient- 
length condition in ( [TT] ) to be feasible for FIR synthesis banks. We will show that PR is generically 
feasible with a synthesis bank that consists of filters with lengths rriy > mf,{C, D,mfi). 

Proposition 1. {sufficient length) A D-fold subsampled C-channel length-rrih FIR analysis FB with 
C/D > 2 is generically invertible, i.e., the FB admits PR with any delay no, < [^] < [^J + [^J —2, 
by a length-m^ synthesis FB if niy > m^(C, D, nih). 
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Fig. 2: Structure of the sampling-domain analysis polyphase matrix IHI2 (for p = 2) of size 10 x 12 corresponding 
to a 6-channel analysis FB with 3-fold subsampling (D — 3) and a filter length of m/i = 7 (i.e., nih-o = 3, rrih-i = 
™/i;2 = 2). The synthesis filter length is to„ = 6 (i.e., m„.2 — 2). The structural zeros are underlined. 
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Fig. 3: Analysis polyphase matrix Hp (for p — 2), with the same structure as in Fig. |2| computed using Algorithm 
[1] for a 6-channel analysis FB with D — 3 and to;, = 7. The synthesis filter length is taken to be the sufficient 
length: m„ — ra^{C,D,mh) = 6. The assigned ones are boxed and the structural zeros are underlined. 



B. Proof of the sufficient-length proposition 

We start by noting that, by Lemma [T| a sufficient condition for PR is that all Hp, p = 0, . . . , D — 1, 
have full row rank. Hence, the following result implies Proposition [T] 

Proposition 2. For a D-fold subsampled C -channel length-ruh FIR analysis bank with C/D > 2, the 
following property holds generically: the sampling-domain analysis polyphase matrix Hp corresponding 
to synthesis filter lengths my > (C, D, nih) has full row rank, for all p = 0, . . . , D — 1. 

Our main tool for proving this proposition is the following result, which provides a test for a matrix 
function to generically have full rank. 

Theorem 1. (Harikumar and Bresler US TV ) 
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(a) Case 1 (b) Case 2 (c) 



Fig. 4: The assigned I's are boxed, the indeterminate zeros are shown as 0, and the structural zeros are underlined. 
(a,b): The two possible cases addressed in Algorithm [T] for allocation of the 1 -diagonal in the k-th block-column, 
separated by the solid vertical line from the previous block-column; (a) No structural zero are present along the 
trajectory of the 1-diagonal extended from the previous block-column; (b) Structural zeros force breaking of the 1- 
diagonal: the assigned 1-diagonal starts just above the structural zeros. Panel (c) shows an example of the undesired 
case for the last block-column, wherein the last row is not covered. 



Let A{u) be an m X n complex matrix function with elements Aij{u) that are multivariate polynomials 
in the elements of u ^ C^. Then, A{u) has full column rank for almost all u £ if it has full column 
rank for at least one u G C*"'. 

The main idea behind this theorem ||37]| is to establish a connection between generic full rank property 
of structured matrices and algebraic sets ||48]| in the Euclidean space of variables The result follows by 
noting that all algebraic sets have zero Lebesgue measure in the Euclidean space. 

To proceed with the proof of Proposition [2| we apply Theorem [T] with the variable vector defined as 
u = vec{ [hi, ... , he]] and A{u) = Hp (for each p = 0, . . . , D — 1). It is easy to see that the entries of 
Hp are polynomials of order zero or one in u. Therefore, to apply Theorem [T| we need to construct a 
particular matrix, with the same structure as HJ, that has full column rank. In other words, we need to 
find a set of analysis filters {hi}^^^ for which Hp has full row rank. 

The following lemma provides the basic idea behind construction of such a matrix. The proof is 
provided in Appendix [Aj 

Lemma 3. Matrix A has full row rank if: (i) each column has at most one nonzero element; (ii) each 
row has at least one nonzero element. 

To use Lemma [3j we construct an analysis polyphase matrix Hp (corresponding to a certain choice of 
the analysis bank) that possesses the two properties listed in the lemma. Given the notions of blocks and 



block-columns described in Section II-B let us consider the analysis polyphase matrix constructed by 



A set is called an algebraic set if it can be written as the set of common zeroes of a system of polynomials 1481 
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Algorithm [T] below. The algorithm sequentially assigns a single nonzero diagonal or sub-diagonal, called 
a 1 -diagonal, to each block-column; here, a row of Hp is called covered if at least one of its entries is 
assigned to be 1. 

Algorithm 1 Matrix construction for proof of Proposition |2] 

(i) - Initialize: Hp = by assigning to all free entries 

(ii) - For the first block-column, assign I's to the top diagonal (corresponding to /ii,o[0] — 1) 

(iii) - While the last row of Hp is not covered, assign the 1-diagonal in the fc-th block-column, k ~ 2,...,C, 

according to the following procedure: 

• Case 1: If no structural zero is present along the trajectory of the 1-diagonaI extended from the previous 
block-column, assign the I -diagonal (for the fc-th block-column) such that the one in the previous block- 
column is extended, as shown in Fig. |4|a). 

• Case 2: Otherwise, assign the 1-diagonal (for the fc-th block-column) such that it starts immediately above 
the structural zeros in its first column — two examples of this case are shown in Fig. |4|b). 

(iv) - If the last row of Hp (last row of C-th block-column) is not covered declare Failure. 



Figure |3] shows the full row rank matrix constructed using Algorithm [T] corresponding to an analysis 
FB with the following specifications: D = 3 subsampling, C = 6 channels, and filter length rrih = 7. 
The synthesis filter length m.^ is taken to be m^{C,D,mh), the minimal value that would satisfy the 
sufficient-length condition in ( [TT] ), i.e., = 6. The assigned I's are boxed and the structural zeros 
are underlined. The corresponding analysis bank is: hi[n] = 5q{7), h2[n] = 5&{7), /i3[n] = (5i(7), 
hM = (54(7), /isM = (52(7), /leN = 5^{7). 

As suggested by the example given in Fig. [2| there are two factors in the structure of Hp that one 
needs to observe when allocating the nonzero entries: (i) the Toeplitz structure of the blocks; and (ii) 
structural zeros that limit the number of free (assignable) entries. The idea in Algorithm [T] is to assign 
a single 1-diagonal to each block-column, which corresponds to assigning only one nonzero tap to each 
analysis filter. It is easy to see that this strategy ensures that the constructed Hp would enjoy Property 
(i) in Lemma [3] — hence, all we need to be concerned with is Property (ii). 

The algorithm starts by initializing the matrix to be all zeros and assigning I's to the top diagonal 
in the first block-column. Assume that we have assigned all of the entries in the first k — 1 block- 
columns, = 2, . . . , C For the /c-th block-column, which corresponds to hk[n], there are two possible 
cases in terms of the structural zeros, as shown in Fig. |4ja,b). Panel (a) shows the simple case, i.e., 
when no structural zero are present along the trajectory of the 1-diagonal assigned for the {k — l)-th 
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block-column. That is, we can simply extend the diagonal trace of I's by assigning the nonzero entry 
of the A;-th column block accordingly. In the example given in Fig. [3j this case applies to all but the 4* 
and 6* block-columns, where the structural zeros prevent the extension procedure just described. Two 
general instances for such nontrivial cases are shown in Fig. |4]^b). To satisfy Property (ii) in Lemma |3j 
we have to assign at least one nonzero entry to each row. As described in Fig. Qb), this is accomplished 
by assigning the 1 -diagonal for the k-th block-column to start at the last free entry in its first column, 
i.e., just above the structural zeros. 

According to Algorithm [TJ the rows in a block-row are progressively covered — i.e., in each step, the 
non-covered rows are at the bottom of the block-row. Hence, covering of a block-row implies that the 
last row is covered. Assume that the assigned nonzero elements used to cover these rows are located in 
column-blocks ki to k2 < C. Then, the filter taps in block-column {k2 + 1) are assigned to cover the first 
m^;p rows of the next block-row without any overlap with those used to cover the previous block-row 
— in short. Algorithm [T] does not "revisit" any block-rows|^ 

Consequently, what remains to be shown (to establish Property (ii) in Lemma [3]) is that there are enough 
block-columns (out of a total of C) to cover all rows of the constructed Hp matrix. Figure Qc) shows a 
possible scenario where the last block-column fails to cover all rows (the bracket on the right-hand side 
shows the bottom-right edge of the matrix). We first show this for p = po where, in accordance with 
Property (c) in (|4]), po is such that rriv-p^ = [my/D\. Let us recall the assumption in the statement of 
Proposition [2] rriy > m^(C, D, rrih). As pointed out earlier, this means that rriv satisfies ( [TT] ), which can 
be equivalently written as follows: 

nih-i + m^-p, - 1 



D-l 

E 

1=0 



< C. (12) 



Now, consider the following lemma (proved in Appendix [A| ). 

Lemma 4. Using Algorithm^ the number of consecutive block-columns required to cover the nih-e + m^-p 
rows of the i-th block-row in Hp (0 < i < D — 1) is equal to \{mfi-i + niy-p — l)/my-p'\. 

By Lemma |4j Inequality (12i guarantees that the C block-columns of Hp^ suffice for the algorithm to 
cover all rows of Hp^ — i.e., avoid the case shown in Fig.^c). Finally, since by Q we have niy-p > rriv-p^, 
( [T2] ) implies that the same argument holds for all Hp with 0<p<£' — 1. Asa result, the condition in 
Line (iv) of Algorithm [T] is not met for any p; hence, the algorithm successfully finishes the construction 

of Hp, < p < L> - 1. □ 



'Note that the top left element of each Toeplitz block cannot be a structural zero. 
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IV. Minimum Length for PR Synthesis Filters: Generic Necessary Condition 

In the previous section, we provided a "sufficient length" condition for PR synthesis banks. However, 
this only partially answers Question Q.2 (Section |l]) as it raises the possibility that the prescribed minimum 
length m^(C, D, nih) is too conservative. To refute this possibility, in this section, we propose a necessary 
condition counter-part to Proposition [T] It states that for synthesis filter lengths below a certain necessary 
length (defined below) PR or delayed PR cannot generically be achieved. Subsequently, we exactly 
quantify the gap between the sufficient and the necessary lengths for each choice of {C, D,mh)- In 
Section |Vj we provide numerical results demonstrating that the gap between these two lengths is indeed 
small (for moderately high oversampling factors). 

A. Statement of the result 

First, let us define the counterpart to the sufficient length m^{C,D,mh)- 
Definition Denote by {C, D,mh) the minimal value of rriy G N that satisfies: 

rrih-p - 1 



C 1 

p=0 



(13) 



rrih-p 
D 



. We refer to as the necessary synthesis filter length — in short, the necessary 



where m/^.p 
length. 

It is easy to show that all > m^{C,D,mh) satisfy ( [T3] ). Therefore, the set of G N satisfying 
(13 1 is a right-sided interval, i.e., all integers in m^{C,D,mh),oo^. Furthermore, the only difference 
between the definitions of the necessary and sufficient lengths (Section IIIi is a floor/ceiling operation in 
the summand. 

The following proposition, the main result of this section, provides a necessary condition counterpart 
to Proposition [T] for PR in generic FBs. 

Proposition 3. {necessary length) A D-fold subsampled C-channel length-rrih FIR analysis bank with 
C/D > 2 and nih > D is generically not invertible, i.e., the FB does not admit PR with any delay uq, 
< < L^J + L^J -2, by a synthesis FB of length m„ < m^{C, D, ruh). 

B. Proof of of the necessary-length proposition 

The condition rriy < m^{C,D,mh) implies that (13i is not satisfied (since the set satisfying ( 13 1 



is a right-sided interval as pointed out earlier). Here, we show that violating ([13) in turn implies that 
generically there exists an integer p G {0, . . . ,D — 1} such that (^^(p.no) ^ ^(Mp) for any no, which 
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by Lemma [T] is equivalent to the proposition. To this end, we construct the augmented matrix Ap = 
[Mp (^^(p^rio)]' ^^'^ ^ill establish that Ap is generically /mZZ column rank, for some p. 

To proceed with the proof, we apply Theorem [l] with A{x) = Ap and x = vec{[/ii, . . . , he]]- The 
entries of Ap are polynomials of order zero or one in x. Hence, if we find a particular set of analysis 
filters {hi]'?^^ such that the corresponding Ap matrix has full column rank, then it will be generically 
full column rank, which in turn proves the proposition. Accomplishing this is equivalent to constructing 
a sampling-domain analysis polyphase matrix Hp (for at least one p) such that: (a) Hp has full column 
rank; (b) ^^(p is linearly independent of all columns of Hp. In what follows, the matrix construction 
corresponds to p = po, where po was defined in Property (c) of (|4]). 

Let us consider the matrix Hp^ constructed by Algorithm [2] below. Note that for the assignment in 
Line (ii) of the algorithm to be feasible we need nih-fi > m-a-p^, which is guaranteed by the following 
lemma|^ The proof is provided in Appendix \a\ 

Lemma 5. With the assumptions in Proposition^ we have mh-Q > m^-p^. 

Algorithm 2 Matrix construction for proof of Proposition |3] 

(i) - Initialize: Hp^ = by assigning to all free entries. 

(ii) - For the first block-column, select the 1 -diagonal to be the {rriy-p^ + l)-th diagonal in the first Toeplitz block 

(corresponding to hi Q[my^p^] = 1). 

(iii) - For the fc-th block-column, k = 2, . . . ,C, select the 1-diagonal according to the following procedure: 

• Case 1: If no structural zero is present along the trajectory of the 1-diagonal extended from the previous 
block-column, assign the 1-diagonal (for the fc-th block-column) such that the one in the previous block- 
column is extended, as shown in Fig. |5ja). 

• Otherwise, 

— Case 2: Assign the 1-diagonal (for the fc-th block-column) such that it starts immediately below the 
structural zeros in its first column — an example of this case is shown in Fig. |5jb). 

— Declare Failure if there are no free entries left below the structural zeros, e.g., as shown in Fig.jSjc). 

(iv) - Let c* be the block-column index of the nonzero entry in the row indexed by K{po,no). 

(v) - If all entries of the row indexed by k(po,"o) are zero then Exit; 

Else, in the c*-th block-column, assign the top diagonal to be nonzero (corresponding to /ic*,o[0] = 1). 



Figure |6] provides an example of the matrix Hp^ with po = 2 constructed by Algorithm [2] for a FB with 

'"For /ii,o[m-„;p„] = 1 to be feasible the length of hi^ should be at least m„;po+l. 
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(a) Case 1 



(b) Case 2 



(c) 



Fig. 5: (a,b): The two possible cases addressed in Algorithm [2] for allocation of the 1-diagonal for the k-th block- 
column, separated by the solid vertical line from the (fc — l)-th block-column; (a) No structural zero are present 
along the trajectory of the 1-diagonal; (b) Structural zeros force breaking of the 1-diagonal: the 1-diagonal for the 
fc-th block-column is chosen such that it would start just below the structural zeros in its first column. Panel (c) 
shows an example of the undesired case for the last block-column, wherein there are no free entries left below the 
structural zeros. 
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Fig. 6: The analysis polyphase matrix Hp^ (size: 16x 12) forpo = 2 and uq = 6 delay (corresponding to k{po, no) = 
13) constructed by Algorithm |2] for a 6-channel FB with D = 3 and nih = 13 (hence, nih-Q = 5, mh-i = mfi-2 — 4). 
Based on the assumption in the proof, the synthesis filter length is taken to be m„ — m^{C, D, rrih) — 1 = 8 (hence. 



™D-2 = 2). The arrow next to H2 indicates the location of the 1 in S, 



K.{po,no)- 



C = 6 channels, D = 3 subsampling, and analysis filter length of mh = 13. The reconstruction delay is 
no = 6 (corresponding to ^t(po,^^o) = 13). In accordance with the assumption m.^ < {C, D,mh), we 
have niy = m^{C, D, nih) — 1 = 8. The arrow next to H2 indicates the row indexed by k(po, ?^o)> which 
is the location of the 1 in ^^(po.no)- The corresponding analysis bank is: hi[n] = 6q{13), h2[n\ = 5i2(13), 
hs[n] = 5i(13), /14N = 57(13), hin] = (52(13), /leN = 6o{13) + ^8(13). 

The first task is to prove that the constructed Hp^ has full column rank. This is accomplished by 
showing that it has the two properties given in the following lemma, which is equivalent to Lemma |3] 
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Lemma 6. Matrix A has full column rank if: (i) each row has at most one nonzero element; (ii) each 
column has at least one nonzero element. 

By construction, Algorithm |2j (a) allocates at most a single 1 -diagonal to each Toeplitz block in Hp^; 
(b) if the 1 -diagonal for some block-column has a maximum row index of ro, then the next block-column 
would not have any nonzero entries at or above the ro-th row. These two observations together imply 
Property (i) above. 

Next, we prove that Property (ii) in Lemma [6] holds. We call a block-column covered (by Algorithm 
[2]| if all of its m^^p^ columns satisfy Property (ii). Owing to the Toeplitz structure of the blocks, any 
1 -diagonal assignment by the algorithm corresponds to covering of a block-column. However, it could 
be that, at a certain iteration of the loop in Line (iii) of the algorithm, there would be no free entries 
(that are below the structural zeros) left to assign. Figure [5jc) shows an example of such a scenario for 
the last (C-th) column-block. In the following we show that, given the assumption of the proof, i.e., 
niv < {C, DjUih), this latter scenario will never materialize. Consider the following lemma. (The 
proof is analogous to that of Lemma |4] and is therefore skipped.) 

Lemma 7. Using Algorithm |2] the number of consecutive block-columns in Hp^ covered by the 



n^h;£ + iT^v;po ~ 1 rows of the £-th block-row (0 < i < D — 1) is equal to \_{mh-i + 



The opposite of ( 13 1, which is implied by the assumption rriy < m,J;(C, D, rrih), can be rewritten as: 



D-l 



n ^ 



rrih-. 



1 



D-l 

C-D<Y^ 

£=0 



rrih-i - 1 



D-l 



£=0 



1 



>C + 1, (14) 



where, in the last step, we assumed m^-p^ = [m^/Dj. Now, summing up the number of consecutive 
block-columns that can be covered by all rows, we have: 



mh-o - 1 



D-l 



1 



D-l 



1+ « + E 



=0 



rrih-.e - 1 



m. 



>-l + C + l = C, (15) 



where we applied ([14]). The inequality in ( [T5] ) implies that there are enough rows to cover all C block- 



columns. Using a similar argument as the one at the end of Section IH-B it is easy to see that Algorithm 
|2] covers the block-columns progressively, i.e., once a block-column is covered it is not revisited. This 



in combination with ( fTS] ) guarantees that the Failure condition in Line (iii) of the algorithm is never 
met; hence, the matrix construction finishes successfully — satisfying both properties in Lemma [6] 

Finally, we show that ^^(p^^no) linearly independent of all columns of the constructed Hp^, which — 
together with the above — establishes that the the constructed (augmented) matrix Ap^ = [Hp^ ^K{p„,no)] 
is full column rank. By inspection, it is clear that the top m„;p^ rows of the matrix constructed in Lines 
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(i)-(iv) of Algorithm [2] are set to zero. Consider two cases based on whether m^;p„ is larger or smaller than 
k(Po, '^o)- If ^(Po, ?^o) < "it);po' the condition in Line (v) of Algorithm |2] holds and no linear combination 
of columns of Mp^ can produce 5k(p„,„q)- For the alternative case of K{po,no) > m^-p^, the 1 in ^^(po.no) 
may share the same row index with at most one nonzero element in Mp^ — denote the corresponding 
column in Hp„ by epjLine (v) of Algorithm |2| (after "Else, ...") ensures that e will have another nonzero 
element in the top m^j^p^ rows of the matrix, i.e., in the first row-block of Mp^. This is demonstrated in 
Fig. [6] where e is the eleventh column and ruy-p^ = 2. Consequently, since K{po,n()) > rriy-p^, column 
e cannot belong to any linear combination producing ^^(po.no)' which in turn implies that ^^{po.no) 
linearly independent of all columns of Hp^ . This completes the proof. □ 

V. Tightness, Gaps, and Closed-form Expressions 

In the previous two sections, we provided generic necessary and sufficient requirements for the length 
of the PR synthesis bank. Here we show that the gap between the necessary length m^{C,D,mh) and 
the sufficient length m^{C,D,mh) is small. In addition, to answer the second part of Question Q.2 of 
Section |lj we study the fundamental relation between the oversampling ratio, the analysis filter length, 
and the required synthesis length. This is facilitated by providing various bounds including closed-form 
upper and lower bounds for the sufficient and necessary synthesis filter lengths, respectively. The derived 



relations are verified and illustrated numerically in Section VI 

Assuming that the FB (Fig. [TJ is oversampled, we start with a simple necessary condition, referred to 
as the counting condition, for all Hp, p = 0, . . . , D — 1, to be full row rank. The proof is provided in 
Appendix |A] 

Lemma 8. {counting length) Assuming C > D, a necessary condition for all Hp (p = 0, . . . , D — 1) 
to be full row rank is 



ruy > my{C, D, nih) = D 



where the integer functional my{C,D,mh) is referred to as the counting length. 



(16) 



The counting length is simply derived by requiring the number of rows to be no more than the number 
of columns for all Hp. Note that, because the condition in Lemma [T] may be satisfied even when none of 



{Hplp^Q^ have full rank, condition (J^i is neither necessary nor sufficient for existence of a length-m-t, PR 



"The case where no such element exists is trivial. 
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synthesis bank. Remarkably, as described below (also revisited in Section VI I, m^(C, D,m/i) is closely 
related to mf,{C, D,mh) and to m^{C, D,mii), derived earlier. 
Applying the basic inequality a < \a] < q + 1, we have 

<m^iC,D,n.,)<D + ^^, (17) 



C/D-1 - -vK-^-^-nj ^ ^ , c/D-l 
i.e., m^(C, L>, mh) is bounded from below and above by functions that each have an approximate inverse 
relationship to C /D, for a fixed m/j. Since the gap between the bounds in ( [TT] ) is small (equal to D), the 
counting length m^{C,D,mh) has an approximate inverse relationship to the oversampling factor C/D. 

The following proposition describes the relationship between the necessary, sufficient, and counting 
filter lengths; it further provides closed-form lower/upper bounds for and m^. The proof is provided 
in Appendix |A] 

Proposition 4. Assuming C/D > 2 and nih > D, we have the following relations between the sufficient 
length m^{C,D,mh), the necessary length {C, D,mh), and the counting length m^[C, D,mh): 



max 



where m]^{C,D,'mh) 



nih - D 
C/D 



and m]j {C, Djirih) — D 



mh- D 



{C + l)/D-2 



In order to draw conclusions from Proposition [4] in terms of the behavior of the various length, we first 
need to quantify the gaps between them — as given in the following corollary. The proof is provided in 
Appendix [Aj 

Corollary 1. Assuming D >2 and C / D > 2, the following bounds apply for the gaps between various 
length functionals: 

rs|N(C, D, mh) = ml (C, D, mh) - m"^ (C, D,mh)<D + l+ ^'"'^ 



D \ D-0.5 



ru|c(C, D, mh) ^ mU(C, D, mh) - m^{C, D,mh)<D + l+ ""c-i 



rc|L(C, D, mh) ^ m^iC D, mh) - mJ;(C, D,mh)<D + l+ ^ 

d\d ^) 



For a generic C-channel Z?-fold subsampled FB, the true minimal PR synthesis filter length, i.e., where 
the "phase transition" between PR-infeasibility and PR-feasibility occurs, is denoted by m*(C, D, mh)- It 
follows that m^ < m* < mf, . Although our results do not exactly pinpoint the true minimal filter length 



m* (see Section VI for a conjecture that it coincides with m\j), we can exactly quantify the gap between 
m^ and mf using their respective definitions. Here instead, combining Corollary [T] and Proposition [4j 
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we study the qualitative behavior of the necessary and sufficient lengths and the gap between the two, 
which in turn enables us to address Question Q.2 raised in Section |l] regarding m*. 

• The gap between and mf, is small. This is because, based on Corollary [Tj T^\^{C, D,mh) drops 
roughly as {C / D)^"^ and is small (relative to mh) for moderately high oversampling factors. For example, 
with D = ?), for C / D > 3, the gap is smaller than 4 + 0.42 x rrih, and for C/D > 4 it is smaller than 



4 + 0.18 X mh- Further, in Section VI we illustrate numerically that this gap is small. 

• has an approximately inverse relation to the oversampling factor Consider the set of inequalities in 
Proposition |4] bounding the sufficient length: < < m^. For a fixed analysis filter length rrih-mP^ 
and subsampling factor D-Dq, this relation shows that the integer function ml{C, DQ,m^), defined on 
the integer line C G N, is "sandwiched" between two other integer functions both of which roughly 
drop as 1/C with increasing C. Moreover, the gap between and m^, denoted as Fuic in Corollary 
[l] is small since: (i) it drops as {C/D)'"^ with increasing C; (ii) based on the proof of Proposition [4] 
(specifically, Part (i) of Lemma|9]in Appendix|A]), this gap is zero for all C = kDo with k > 2. Therefore, 
mf, itself should behave similarly. The same argument can be repeated for a fixed C and decreasing D. 
This shows that mf, has an approximately inverse relation to C/D. 

• has an approximately inverse relation to the oversampling factor Similarly to the above, based on 
Proposition |4j the necessary length is sandwiched between mj; and m^. Moreover, the gap between 

and m^, denoted rc\i^{C, D,mh) in Corollary [Tj drops roughly as (C/D)^'^ and is small. For 
example, for C/D > 3, the gap is smaller than D + 1 + {nih/Q). Specifically, for nih = 17 and D = 2, 
TciL ^ 5. Hence, m^{C, D ,mh) itself has an approximate inverse relation to C/D. 

• m* has an approximate inverse relation to the oversampling factor Summarizing the abovementioned 
relations, the integer functionals rnJ^ and both behave (approximately) as [C/D)^^. Also, the gap in 
between them drops roughly as {C/D)~'^ and is small (relative to rrih). This implies that m*, which lies in 
between and ml , should itself have an approximate inverse relation with respect to the oversampling 
factor C/D. This answers the second part of Question Q.2 in Section |l] and is further demonstrated in 
Section |Vll 

The inequality < rrih stated in Proposition |4] implies that, with C/D >2, the true minimal PR 
synthesis filter length m*{C, D, rrih) is generically less than the analysis filter length m/j. Note the lower 
bound D for all lengths, which implies m*{C, D, mh) > D; this is can be inferred from the FB structure 
(Panel (a) in Fig. [T]), as a shorter synthesis filter would not be able to "fill in" the D-sample gap at the 
output of the up-samplers. 
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Finally, let us consider Question Q.l raised in Section |T] Based on Proposition [T] (with mo = 0), a 
length-m„ PR synthesis bank exists generically for any m„ > m^(C, D, nih), where, based on Proposition 
4j ml{C, D,mh) < rrih < oo. This implies feasibility of PR using FIR synthesis filters. The following 
corollary states this observation. 

Corollary 2. For a D-fold subsampled C -channel FIR analysis bank with C/D > 2 and rrih > D, 
the following property holds generically: an FIR synthesis bank achieving PR with any no delay (O < 
m<[^\ + [^\- 2) exists. 



A recent result due to Law et al. 11381 . specialized to a single- variate polynomial matrix, states that 
if C > D + 1, then a. C x D single-variate polynomial matrix is generically (Laurent) polynomial left 
invertible. Applying this result to the analysis polyphase matrix A{z), we can deduce that for generic 
oversampled FBs A{z) has an FIR left inverse, which corresponds to the synthesis polyphase matrix 
Tl{z) according to Therefore, the result in |[38l implies Corollary |2] and hence is stronger. However, 
as mentioned in Section |lj Law et al. ||38]| do not address the filter support/length question (Q.2 in Section 

which is the focus of the present work. 

VI. Numerical Results: Verification of the Propositions and Further Observations 

The first part of this section provides numerical verification of the results in Section |Vj as summarized 
in Proposition |4] In the second part, we provide Monte-Carlo simulations results that provide a numerical 
verification of the Propositions [T] and |3] in Sections III and |IV| respectively. A byproduct of the presented 



numerical results is a conjecture on the true minimal filter length for PR. In the last part of this section, 
we study the feasibility of imperfect (near perfect) reconstruction using synthesis filter lengths below 
those prescribed (for PR) by our propositions. 

Figure [7] shows the necessary, sufficient, and counting filter lengths as functions of the number of 
channels C, for an analysis filter length of mh = 30 and subsampling factors of: (a) D = 1; (h) D = 2; 
(c) D = 3; (d) D = 4. The upper bound is also overlaid on the plots and the dashed line in each 
panel marks the analysis filter length nih- Therefore, it is easy to verify the upper bound min(m/i, mj/) 
in each panel. Next, Panel (a) of Fig. [8] plots the necessary, sufficient, and counting lengths for two 
different analysis filters lengths: nih = 30 and nih = 64. The results demonstrate that the gap between 
the filter lengths becomes negligible for moderately high oversampling factors. In Panel (b), plots of 
the various rriv filter lengths is provided as a function of subsampling factor D for a fixed number of 
channels C = 12 and analysis filter length of ruh = 30. The results suggest the the minimally required 
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(c) (d) 
Fig. 7: The necessary (m^), sufficient (m^), and counting (m^) filter lengtlis as function of tlie number of cliannels 
C, for an analysis filter length of nih — 30 (marked by the dashed line in each panel) with subsampUng factors of: 
(a) D ~ 1; {h) D ^ 2; (c) D = 3; (d) D = 4. The closed-form upper bound to^ is also shown. 



synthesis filter length for PR increases approximately proportional to the subsampling factor D, with a 
fixed number of channels and analysis filter length. 

Together Figs. [7] and [8] demonstrate that the gaps between the necessary, the sufficient, and the counting 
lengths are small. Further, these numerical results verify: (i) the upper bound min(m/i,mj/) given in 
Proposition |4| (ii) the relationships between the different filter lengths, also given in Proposition |4] 

Next, we move on to verification of the propositions. Figure |9] shows Monte-Carlo (M-C) simulation 
results for studying PR feasibility among randomly generated analysis FBs with 3-fold subsampling 
(D-S) and C = 1, . . . , 24 channels (horizontal axis). Each M-C run (from a total of 200) corresponded 
to generating an analysis FB comprising C real-valued analysis filters of length rrih = 30, based on a 
uniform distribution with zero mean and variance of 100. The color-bar in the figure encodes the number 
of M-C runs (out of 200) for which a PR synthesis bank (allowing for multiple-of-3 delays) consisting 
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Fig. 8: (a) Comparison of the necessary, sufficient, and counting filter lengths for two different analysis filters 
with lengths nih — 30 and mh = 64, demonstrating that the gap between the filter lengths becomes negligible for 
moderately high oversampling factors; (b) Various rriv filter lengths as a function of subsampling factor D for a 
fixed number of channels C = 12 and analysis filter length of = 30. 



of C filters with length (vertical axis) exists. For each generated analysis FB, the computational 
process for determining numerically whether or not a PR synthesis FB exists involves checking the range 
condition in Lemma [l] for all feasible choices of no. The counting and sufficient lengths, niy and m^, 
are overlaid on the graph as a function of C. As is seen from the figure, for C > 2D = 6, all synthesis 
filter length choices satisfying m„ > mf, resulted in 100% success in achieving PR. This verifies the 
claim of Proposition [T] The figure also shows that none of synthesis banks with filter lengths below the 
counting length achieved PR (or delayed PR). Moreover, since the necessary length bounds the 
counting length from below (Proposition [4]), the M-C results verify that none of the synthesis lengths rriy 
that satisfied m^, < < mf, resulted in PR — therefore, the minimal filter length that would allow for 
PR is at least as large as the derived necessary length. Consequently, the M-C results indirectly verify 
the claim of Proposition [3] as well. 

The simulation results in Fig. |9] suggest that the counting length m^{C,D,mh) is both sufficient 
and necessary for feasibility of PR with a length-mt, synthesis FB, i.e., the true minimum length m*, 
introduced in Section [vj coincides with m^. This provides grounds for the following conjecture. (Note 
that, based on the bounds in Proposition |4j this conjecture is consistent with the requirement that the 
true minimum length should lie in between the necessary and sufficient lengths.) 

Conjecture. For a D-fold subsampled FIR analysis bank {hi}f^i with rufi > D, the following property 
holds generically: a length-niy synthesis bank that achieves PR exists if and only if rriy > m^(C, D, mh). 
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Fig. 9: Monte-Carlo simulation results, with randomly generated length m/i = 30 analysis filters, for verification 
of the propositions with G channels (horizontal axis) and Z?=3 subsampling. The color-bar indicates the number 
(out of 200) of Monte-Carlo runs for which a PR synthesis bank of length ra^ (vertical axis) exists. The counting 
and sufficient lengths, and m^, are overlaid on the graph as a function of C. 



Regardless, as was pointed out in Section |V] and verified in the results above, the gap between the 
counting length and our proven necessary and sufficient lengths is small, especially for moderately high 
oversampling factors. 

In the last part of this section, we consider the feasibility of imperfect (near-perfect) reconstruction 
using synthesis filter lengths below those prescribed for PR by our theoretical results. To do so, assuming 
noise-free data, we need to compute the reconstruction error (distortion) resulting from FIR synthesis 
with different synthesis filter lengths. That is, for each choice of niy, we solve each of the D (sampling- 
domain) polyphase matrix equations in ( [TO] ) by applying Hp to both sides. Next, we collect all of the 



solutions to construct the synthesis bank, which enables computation of the reconstructed signal x[n] 

given the input x[n]. The resulting normalized reconstruction distortion (in percentage) is defined as 

x[n] — x[n\ /||x[n]|| x 100. Fig. 10 a) shows this normalized reconstruction distortion as a function 
2 " I ~ 

of m^, the synthesis filter length, for a FB with D = 3 subsampling and rrih = 30 analysis filter 
length. Results corresponding to two input signals, x[n\, are shown: one randomly generated with length 
nix = 100 (solid line) and one taken to be the unit pulse (dashed line). As is seen from the figure, the 
reconstruction distortion is zero for values satisfying niy > = 21, which is consistent with the 



V 

C 



results in Fig. |9j but the distortion jumps to more than 10% (for both inputs) when drops below 
and is more than 30% with rriy = — 3 = 18. 

Finally, to study the effect of different analysis FB realizations on the resulting distortion, we conducted 
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(a) (b) 
Fig. 10: Signal distortion caused by synthesis filters that are too short, (a) Normalized reconstruction distortion in 
percentage (noiseless scenario) as a function of ruy, the synthesis filter length, for a fixed (randomly generated) 
analysis FB with D = 3 subsampling and filter length of nih ~ 30; results corresponding to two input signals, 
x[n], are shown: one randomly generated with length rrix — 100 (solid line) and one taken to be unit pulse (dashed 
fine), (b) Boxplot showing the distribution of normalized distortion (in percentage) as a function of the number of 
channels C corresponding to 200 Monte-Carlo runs with the following scenario: the C-channel analysis FB (with 
D = 3) is generated randomly with a zero-mean i.i.d. unit-variance uniform distribution and reconstruction error 
corresponding to a synthesis FB of length — [0.9 x my{C, D,mh)] is computed. 



the following M-C simulation: normalized reconstruction distortions using a C-channel 3-fold subsampled 
FIR synthesis FB were computed as a function of C corresponding to 200 Monte-Carlo runs, where in 
each run the analysis FB is generated randomly from a zero-mean i.i.d. unit-variance uniform distribution 
and the reconstruction distortion corresponding to a synthesis bank of length niy = [0.9 x m^{C, D, mh)~\ 



is computed. The results are demonstrated in Panel (b) of Fig. 10 using the boxplot scheme 11491 . On 
each box, corresponding to a certain value for C, the central dot is the median of the distortion error 
percentage, and the edges of the box are the 25* and 75th error percentiles. Each box has two whiskers, 
which are a way to represent the range of variations of the error "population" whereby the upper and 
lower limits are extended to the most extreme data points not considered "outliers" ||49| . Outlier^ are 
not shown. The maximum number of outliers was 5 (corresponding to the box for C = 7), i.e., the 
whiskers cover at least 97.5% of the error values for each box. As is seen from the figure, even a small 



Specifically, for each box, error values points are considered outliers if they are larger than + 1.5(q3 — qi) or smaller 
than qi — 1.5(q3 — qi), where qi and qs are the 25"^ and 75*'^ percentiles of the error samples for the box, respectively. This 
range qs — qi is typically referred to as the inter-quartile range (also called the mid-spread) and the factor 1.5 here is referred 
to as the whisker length. 
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deviation (here about 10%) from the minimally required filter lengths results in significant reconstruction 
distortion. (Note that for some FB realizations, the distortion can be quite small. However, this rarely 
happens: for the case of C = 16, only 6% of the generated FBs result in distortion of less than 



Overall, the results in Fig. 10 demonstrate that there would be little benefit in attempting to achieve 



non-perfect reconstruction to allow for synthesis lengths below those suggested by our propositions. 

VII. Summary and Conclusions 

In this paper, we addressed the feasibility of PR using short FIR synthesis filters given an oversampled 
but otherwise general FIR analysis filter bank. We provided prescriptions for the shortest filter length of the 
synthesis bank that would guarantee PR. Our results are in the form of necessary and sufficient statements 
that hold generically, that is, only fail for contrived examples and pathological cases. For oversampling 
factors of at least two, we showed that our prescribed length for the synthesis filters is shorter than the 
analysis filters, decreases with increasing oversampling, and is close to the derived necessary length for 
moderately high oversampling factors. Finally, using numerical studies, we demonstrated that choosing 
filter lengths that are only slightly below the prescribed regime results in significant signal distortion. 
The results have potential applications in synthesis FB design problems where the analysis bank is given, 
e.g., in multi-channel sensing/imaging systems where the channel characteristics are determined by the 
physics of the problem and cannot be fully manipulated. In addition, the presented work helps analyze 
and understand fundamental limitations in blind reconstruction of signals from data collected by unknown 
subsampled multi-channel systems. A future area of research is to extend the results to higher dimensional 
signals and filter banks. 

Appendix A 
Proofs of Lemmas 

Proof of Lemma |2] 

The sufficient-length condition in ( [TT] ) can be rewritten as 

^\{m,,-p)ID]-l 



E 

p=0 



<C-D<D, (18) 



where the right-most inequality holds for C < 2D. However, each of the D terms in the sum on left- 
hand side is at least 1 since nih > 2D. Therefore, the sum is greater than or equal to D, which is a 
contradiction. □ 
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Proof of Lemma |3] 

The proof is by contradiction. Assume A is not full row rank. Therefore, there should exist a row in 
A, say, the m-th row, that is a linear combination of the other rows. By Property (ii) in the statement 
of the lemma, this row has at least one nonzero element, say, the n-th element. Consider this (m, n)-th 
entry: A[m, n] ^ 0. According to Property (i) stated in the lemma, no other nonzero element exists in 
the n-th column of the matrix. Therefore, ^4 is a linear combination of zero elements and is therefore 
zero. This is a contradiction with j4[m, n] ^ 0; hence, the result. □ 

Proof of Lemma |?] 

First, note that the problem can considered independently for each of the block-rows since each Toeplitz 
block in Hp only belongs to one block-row. It is easy to see that the lemma's claim is equivalent to 
asserting that, using Algorithm [T] among the 1 -diagonal assignments that cover the rows in the ^-th 
block-row only the last one can be of the nontrivial type shown in Fig. Qb). To prove this, note that 
assigning 1 to the last free entry (i.e., the free entry with the highest row index) in the first column of 
a Toeplitz block means that the bottom-right entry of the block (corresponding to the last row and last 
column in the block, which is never a structural zero) would be assigned 1 as well. Therefore, the last 
row of the block-row is assigned a nonzero entry, i.e., the entire block-row is covered. □ 



Proof of Lemma |5] 



The necessary length defined in (13 1 is an integer functional from N onto N: 



iridic, D, mh) = mill < G N 



C 1 



D 



p=0 



(19) 



Aproperty of this functional is that m^(C, D, mh) < mh (given C / D > 2 and ruh > D), which is proven 
as part of the proof of Proposition [4] in this appendix. Therefore, the assumption < {C, D,mh) 
implies m„ < nih- We have 



TTlh-O 



rrih 
D 



^ ruh ruy ^ 
- D D - 



my 
D 



m. 



where, in the last step, we used Property (c) in Q. 



□ 
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Proof of Lemma |S] 

For p-th sampling-domain polyphase condition in ( fTO] ), a necessary condition for the matrix Hp 
full row rank is for its number of rows to be less than or equal to its number of columns: 



to be 



rrih + Dniy-p — D < C niy-p 



ruh- D 



'"'■/d - 1 



This inequality should hold for all rriy-p where p = 0, . . . , L> — 1. Therefore, it should hold for 

min(p=o,...,D-i) "^d;p = [i^v/D\, where we used the definition of rriy-p described in Section 



II-B 



Therefore, we have 



D 



> 



c 



(20) 



Now, it is easy to check that m^(C, D, rrih) = D (^—1) /(^— 1) satisfies (20l, whereas m\,{C, D, nih) — 1 
does not. Therefore, m^{C, D,mfi) is the smallest integer that satisfies the condition in ( |20l ). □ 



Proof of Proposition |4] 

The results in Proposition |4] follow from combining those in the following two lemmas. Lemma |9] 
provides a set of properties including a closed-form upper bound for the sufficient length m^: 

Lemma 9. If C/D >2 and nih > D, then m^{C, D,mh) has the following properties: 



(i) = if C = kD for integers k > 2. 

(ii) < < min(m/i, mj/), where m]^ {C, D,mh) = D + 



nih - D 



{C + l)/D-2 



Lemma 10 describes the relationship between the necessary, sufficient, and counting filter lengths: 

Lemma 10. If C/D > 2 and m/j > D, then rriy (C, D,mfi) has the following property: 

rrih- D 



max (L), mj;) < < < mf,, where m^(C, D, nih) 
Proofs for Lemmas |9] and [10] are included below. 



C/D 



Proof of Lemma^ PART (i). First, let us show that for a real positive number a and an integer M, 
\a/M~\ > \a]/M. This trivially holds for a G N. To show this for a ^ N, define [a]i = a — [a\ , and 
write [aj = niaM+ra where the remainder satisfies < r„ < M—1. Therefore, the left-hand side of the 
inequality is [a/M] =ma+ (ra + [a]i)/M = m^ + l, where we used rQ, + [a]i < M — l + [a]i < M. 
Similarly, the right-hand side can be written as: \a] /M = ( [aJ + 1) /M = nia + {va + 1) /M < nia + 1, 
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which completes the proof. Now, consider a synthesis filter length m* that satisfies the "counting" 
condition given in ( [76] ) (in Lemma [8|. By definition, m* > m^. With C / D = k £ N, we have that: 

\mh/D - 1] \mh/D - I 



D 



> 



mh/D-1 
k-1 



> 



k - 1 



[m*jD\ 



where we used the property proved above with a = ruh /D — 1 and M = k 
it is assumed that m/j > D. Consequently, we have: 



\mh/D - 1] 
[m*jD\ 

Hence, 



<k-l 



\mh/D] 



1 



D~l 

E 

p=0 



\ml/D 
'\{mh-p)/D] 



<k-l 



{ruh -p)/D 



1 



[m*jD\ 



<k-l, 

- 1; also [ml/D] > since 
<k-l iO<p<D-l) 



<{k-l)D = C- D, 



(21) 



lmt/D\ 

since C = kD. Comparing ( fTS] ) and ( |2T] ), it is clear that any m* satisfying the counting condition in 
(16 1 would also satisfy the generic sufficient condition in Proposition [T] Hence, based on the definition 
of rUy, it follows thaj^m^ < (for the case of C = kD). On the other hand, as will be shown below, 
> "i^ (in general). This concludes the proof of = (given C = kD). 

Part (ii). The proof has three parts as given below. 

(ii-1) Proof of < m^. Based on the proof of Proposition [l] it is clear that the condition for rriy in 
the proposition is a sufficient condition for all Hp (p = 0, . . . , D — 1) to be generically full rank (which 
in turn implies PR for the filter bank). In the proof, a particular matrix construction for Hp is provided 
that is shown to have full row rank. Now, a necessary condition for all Hp to have full row rank is given 
in Lemma [s] Consequently, since is, by definition, the minimum niv satisfying that condition, we 
have: > m^. 

(ii-2) Proof of < ruh. With C > 2D, we have: D < C — D. Therefore, to prove < m/j all we 



need to show is that ( 18 1 holds for the choice of rriy = nih. For p = 0, . . . , D — 1, we have 



'nih -p' 


- 1 < 




- 1 < 




D 




D 




I D J 



\{mh-p)/D]-l 



< 1 



\{m^,-p)/D] -1 
lmh/D\ 



< 1, 



[rrih/D] 

where the second step follows from the assumption of mh > D (as stated in the lemma). Summing this 
up for all p = 0, . . . , D — 1, completes the proof: 



D-l 

E 

p=0 



\{mh-p)/D] - 1 
[mh/D\ 



< D < C -D. 



'"'This is equivalent to saying that: min rriv < min m^,, when Si^ 82- 
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(ii-3) Proof of < m^. Note that we can bound the left-hand side of lemma's condition (J^l as 
follows: 



D~l 

E 

p=0 



mh-p - 1 
[my/D\ 



D~l 



< 



p=0 



rrih-p - 1 
[my/D\ 



1 ^"^ 

^ + [m,/D\ ^ 
p=0 



ruh- D 



rriv/D — 1 



(22) 



where we used the identity ^n=Q f^h-p = "i/i- The following shows that if my is chosen such this upper 



bound is no more than C — D + \, then the sufficient-length condition, restated in ( [T8| ), would be satisfied: 

D-l 



my/L> — 1 

' V ' 

(*) 



p=0 



ruh-p - 1 
[mjD\ 



D-l 

E 

p=0 



1 



m^/ U — 1 



<C-D. 



[mjD\ 

Note that if mj/ £ N satisfies (*), then based on the definition of in Section III-A we would have 
< m^. All that remains to be shown is that given in the statement of the lemma satisfies (*): 
mh- D 



D + 



{C + l)/D-2 



{C + l)/D-2 



^„,_Z,<(!=f-l)(c+l-2I,)^Z,+ ;|^<C-fl + l. 
where we used the assumptions C > 2D and ruh > D. This completes proof of Lemma |9] □ 



Proof of Lemma 10- We first show the lower bound: > max {D,ml), where = [^^^]. 



The inequality > D is trivial. Rewriting (13 1, we have: 



D-l 
p=0 



rrih-p - 1 



D-l 

>E 

p=0 



- LmN/Dj mh-D - C 



rrih-p - 1 

N 



-D + 



D-l 



ruh- D 



D 



nih- D ruh-D ^ 



K/D\ 

nih, — D~ 
C/D ■ 



The inequality < ml was already shown in Lemma |9j Part (ii). In the following we prove that 
rriy < m^. For any integer my > D, it follows that: 



D-l 

E 



mi-/ - 1 
[my/D\ 



< 



E 

£=0 



ruh-i - 1 _ -D + X]£=o^ _ mh - D 



[my/D\ 



[my/D\ 



[my/D\ 



(23) 



Next, assume an integer satisfies the counting condition given in ([16]), i.e., m^ > m^. We have: 

"my^ - 1 



rnv_ 
D 



> 



C 



niy 
D 



C7 



/Z)-1 



(24) 
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where we used m„ > D, which is impUed from mh > D and (16i. Combining (23 1 and (24 1, we have: 

D-l 



E 

e=o L 



[m,/D\ 



<C-D. 



(25) 



This means that rriy satisfies the necessary length condition of Proposition |3] given in ( [73] ), which by the 
definition of m^, implies that < < m^. This completes the proof of Lemma 10 □ 



Proof of Corollary [7] 

Applying Lemmas |9] and 10 it follows that: 



Ts\t^{C,D,mh) < m^{C,D,mh) - m\;{C,D,mh) 



„ mi, — D mi, — D „ mi, — D „ 2mh 

< 1 + D + 7 ^777^ = 1 + ^ + ^ :-<l + D+ ^ 



c+i 

D 



C/D 



c / c 



c c 



D\2D-l D\D-0.5 

where we used the assumption C/D > 2. 

Applying ( fTTj ) and definitions of m^ and mj; given in Lemmas [o] and 10 respectively, we have: 

mh - D \ _ fruh - 



T^c{C,D,mh) < {1 + D + 



c+i 2) \ g-l 



<l + D + 



where we applied the assumptions D >2 and C/D > 2. 



mh 

;g-i)(fei-2)- 
mh 



c 




D 





□ 
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